Alignment-based sense selection in METEOR and the RATATOUILLE recipe
نویسندگان
چکیده
This paper describes Meteor-WSD and RATATOUILLE, the LIMSI submissions to the WMT15 metrics shared task. MeteorWSD extends synonym mapping to languages other than English based on alignments and gives credit to semantically adequate translations in context. We show that context-sensitive synonym selection increases the correlation of the Meteor metric with human judgments of translation quality on the WMT14 data. RATATOUILLE combines MeteorWSD with nine other metrics for evaluation and outperforms the best metric (BEER) involved in its computation.
منابع مشابه
Optimal Strategies of Increasing Business Alignment, in Social Security Organization, with Quality Function Deployment (QFD) Approach
Considering the importance of the concept of strategic alignment of information technology (IT) in today economic organizations, this study attempted to extract the organization's IT strategies in order to increase the degree of strategic alignment and consequently the optimal strategies in the field of marketing and service delivery for social security organization. Using QFD technique and hie...
متن کاملMETEOR-WSD: Improved Sense Matching in MT Evaluation
We present an initial experiment in integrating a disambiguation step in MT evaluation. We show that accounting for sense distinctions helps METEOR establish better sense correspondences and improves its correlation with human judgments of translation quality.
متن کاملPhrase alignment confidence for statistical machine translation
The performance of phrase-based statistical machine translation (SMT) systems is crucially dependent on the quality of the extracted phrase pairs, which is in turn a function of word alignment quality. Data sparsity, an inherent problem in SMT even with large training corpora, often has an adverse impact on the reliability of the extracted phrase translation pairs. In this paper, we present a n...
متن کاملGenetic worth and stability of selection indices in rice (Oryza sativa L.)
Improvement of one trait on its own will affect the performance of other traits because ofgenotypic correlations between traits. Index selection is one of the tools used by plant breedersto overcome this problem. The purpose of this paper is to evaluate selection indices developedfor improving grain yield in rice (Oryza sativa L.). Forty-nine rice genotypes were cultivated atTonekabon Rice Rese...
متن کاملComparing uncertainty data in epistemic and ontic sense used to decision making problem
In the paper aspect of comparability alternatives in decision making problem by imprecise or incomplete information isexamined. In particular, new definitions of transitivity based on the measure of the intensity preference between pairsof alternatives in epistemic and ontic case is presented and its application to solve decision making problem is proposed.
متن کامل